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® Touch screen form entry system. 

© A personal computer (20) connected to a display 
and touch screen panel (15) is provided with a form 
entry system integrated therewith. The form entry 
system is adapated to display a predefined form 
(e.g. 30). and to automatically display a predefined 
tool, such as a keyboard, menu, calculator, etc., 
(40,50,60,70,80,100,110) to facilitate inputting infor- 
mation in a respective field of the form or chart. 
Specifically, the user is prompted as to which field is 
to be filled in by highlighting the field (e.g. 41), and 
concurrently displaying as an overlay (window) the 
tool (e.g. 40) that the user will use to input the 
information identified in the highlighted field. In the 
case where a field calls for, for example, the inser- 
tion of a name, the system may be adapted to 
display a menu of names as the tool for filling in that 
field. The user selects the name that he or she 
desires to be inserted in the field by touching that 
name. The system responsive thereto inserts the 
name in that field, highlights the next field to be 


filled in and displays the tool for filling in that field. 
They system may also be adapted to communicate 
with a host computer (1 40) to obtain the information 
that is to be inserted in one or more fields. Also, the 
user may erase the tool that is displayed by the 
system an direct the system to display another tool, 
such as the aforementioned keyboard. 
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TOUCH SCREEN FORM ENTRY SYSTEM " ' " 


Field of the InventionT he invention relates to date 
entry arrangements. 

Background of the Invention 

n is well known that such persons as securities 
traders, sales people, order takers, nurses, etc., 
spend an appreciable amount of time over the 
course of a day manually filling in various forms, 
such as purchase orders, charts, etc. Various tech- 
niques have been devised to reduce the amount of 
time spent filling in such forms. One such tech- 
nique displays the fields of a form on the cathode 
ray tube or other display of a computer. A user 
"fills in" the displayed fields by entering the in- 
formation called for by each field using the com- 
puter keyboard. However, the amount of time that 
such known techniques save over the manual 
method of filling in a form is not substantial when a 
user thereof is not proficient in using a computer 
keyboard. 


Summary of the Invention 

We have recognized that a more desirable • 
approach to providing a computerized form entry 
system is one that upon displaying a form indicates 
in a predetermined sequence which of the informa- 
tion fields of the displayed form a user is to fill in 
and concurrently displays one of a plurality of 
predefined tools adapted to specifically facilitate 
the inputting of the information cailed for by that 
field. Specifically, in our arrangement, the field that 
is to be filled in by the user is highlighted and the 
tool which the user operates to fill in the highligh- 
ted field is displayed as an overlay (window) on the 
form. A tool could be, for example, a calculator, a 
keyboard, a date pad, etc. 

In accordance with one aspect of the invention, 
the form entry system may be arranged to commu- 
nicate with illustratively a host computer during the 
course of filling in a form or chart to obtain the 
entries for one or more fields thereof. In accor- 
dance with another aspect of the invention, one of 
the displayed fields could be a bit-mapped graph- 
ics field which the user fills in by writing on the 
touch screen using a hand-held stylus. In accor- 
dance with another aspect of the invention, the 
user may erase a displayed tool and bring up 
another tool and use the other tool to fill in a 
respective field. 


Brief Description of the Drawings 

These and other objects and features, together 
with the operation and utilization of the present 

s invention, will be more apparent from the illustrative 
embodiment shown in conjunction with the draw- 
ings in which 

FIG. 1 illustrates a computer arrangement in 
which the present invention is illustratively imple- 

to mented; 

FIGS. 2 through 10 show various stages of a 
customized form displayed by the computer ar- 
rangement of FIG. 1 in which a field in the form is 
filled in using a respective displayed tool in accor- 

75 dance with the invention; 

FIG. 11 depicts a menu of predefined tools 
that is displayed by the computer arrangement of 
FIG. 1 when a user points to a respective one of 
the function keys shown in FIGS. 2 through 10; 

20 FIG. 12 shows a telephone station set tool 

which may be displayed by the computer arrange- 
ment of FIG. 1 to establish a telephone call; 

FIG. 13 is a simplified block diagram of the 
computer arrangement of FIG. 1; 

25 FIG. 14 is a simplified block diagram show- 

ing a central computer connected to a plurality of 
other computers, such as the computer depicted in 
FIG. 1. the computers, in turn, being shown con- 
nected to respective display panels; 

oo FIGS. 15 and 16 are flowcharts describing 

the operation of the computer arrangement of FIG. 

1 in relation to. inter alia, filling in the form of FIGS. 

2 through 10, in accordance with the invention; 

FIG. 17 shows the manner in which FIGS. 15 
35 and 16 should be arranged; and 

FIG. 18 illustrates a portion of memory con- 
tained within the computer of FIG. 1 in which is 
stored, inter alia, the form shown in FIG. 2. 

40 

Detailed Description 

Form entry system 10 depicted in FIG. 1 in- 
cludes personal computer 20 and display panel 15. 

45 Computer 20 operates under a predetermined op- 
erating system - such as, for example, the MS- 
DOS operating system available from Microsoft. 
Inc. The computer includes a display 21 , keyboard 
23 and floppy diskette unit 22 as well as other 

so internal components not explicitly shown in FIG. 1. 
such as a hard disk unit. The keyboard 23 provides 
a mechanism for the user to input instructions to 
the computer, such as an instruction to bring up a 
predefined screen pattern on display 21. In the 
practice of the invention, display 21 is not required 


2 


3 


0 271 280 


4 


since any pattern that is brought up on display 21 
is also brought up on display pane! 1 5. 

In particular, panel 15 includes a touch-sen- 
sitive screen 16 overlaying a display device, for 
example, an ac plasma display. The touch-sensitive 
screen could be, for example, the TlX touch screen 
available from' the Elographics Company of Oak 
Ridge, Tennessee, and the ac plasma display 
could be, for example, the D0640LB ac plasma 
display available fro DIXY Corporation of Japan. 
The display 21 and the D0640LB ac plasma dis- 
play each comprise 400 rows of 640 picture ele- 
ments (pixels) in each row and therefore, both are 
suitable for displaying so-called bit-mapped graph- 
ics. 

Cable 17 includes a multilead bus connected 
between the ac plasma display and a video 
(monitor) output port (not shown) located at the 
back of computer 20. It also includes signal leads 
connected between touch-sensitive screen 16 and 
a touch-screen controller circuit board mounted in 
an available computer 20 circuit board slot (not 
shown). When touch-screen 16 is touched by the 
user, the voltage levels appearing on particular 
signal leads of cable 17 change. The touch-screen 
controller decodes these changes in the signal 
levels into x and y coordinates, which define the 
location that is being touched. 

As will be discussed below, a user of the 
invention may design a customized form for dis- 
paly on panel 15 such that the fields of the form 
are highlighted one at a time in a particular pattern, 
such as a sequential pattern. Moveover, the user 
may associate a predefined too! with a particular 
field and have that tool displayed as an overlay 
when the associated field is highlighted. When the 
user enters information in a highlighted field using 
the displayed toot, the system automatically ad- 
vances to the next field to be filled in, highlights 
that field and displays the tool that will be used to 
fill in the field. 

Referring now to FIG. 2, there is shown an 
illustrative example of a customized form which 
may be displayed on the ac plasma display of 
panel 15 after the computer 20 is turned on and 
has performed some initial tasks including the 
"booting" of the operating system from the afore- 
mentioned hard disk unit, and a screen command 
identifying the form has benn inputted into com- 
puter 20 via keyboard 23. Form 30 comprises two 
pages in which the first page is shown in FIGS. 2-9 
and the second page is shown in FIG. 10. 

Form 30 is illustratively a customized form for 
ordering a particular model of automobile from the 
fictitious Saturn Motor Company (SMC). The form 
comprises a plurality of information fields each 
identifying the kind of information to be inserted 
therein, such as Model, Year, Qty (quantity), etc. 


The fields, when filled in by a user (e.g.. a sales- 
person), define a particular model of automobile 
having a particular set of options, the options being 
filled when the user reaches the options section 31 

5 'of the form. Also, special equipment may be or- 
dered when the user points to the box labeled SP 
EQUIP, as will be discussed below. 

(The term "points to" and the variants of that 
term as used herein is meant to include other 

to terms that are understood by the art and which 
define similar functions. For example, it includes 
such notions as moving a screen cursor to the 
location of displayed text or to an entry in a menu 
of entries and operating, for example, an enter key; 

75 as "touching" the screen as one would touch the 
touch screen 16 of panel 15; or even as identifying 
particular displayed text or a menu of entries using 
terminal buttons, for example, computer keyboard 
buttons.) 

20 It is seen from FIG. 2 that the fields of form 30 

are actually constructed from a plurality of vertical 
and horizontal lines, such as lines 20, 21, 23, 24 
and 25 which define fields 41 and 51 labled Model 
and Year, respectively. Function keys 32 through 

25 37 and the manner in which a user specifies the 
various horizontal and vertical lines to construct the 
fields of a customized form will be discussed be- 
low. 

When a form is first brought up on panel 15, 
30 one of the fields in the form is illustratively high- 
lighted and, in accordance with the invention, the 
predefined tool for filling in that field is concurrently 
displayed illustratively as a window overlaying the 
form. 

35 Specifically. FIG. 3 shows form 30 when it is 

first brought up on panel 15. It is seen from FIG. 3 
that the first field in the form-the Model field 41 -is 
highlighted and the tool 40 for filling in that field is 
displayed as an overlay (window) on form 30. In 

40 this instance, tool 40 is a menu of predefined 
entries (or items) 42 through 46 representing re- 
spective models of automobiles available from 
SMC. To enter information in field 41. then, in 
accordance with a feature of the invention, all that 

45- the user needs to do is to point to one of the 
entries 42 through 46. 

(Other functions related to a displayed tool can 
be invoked by touching tool movement icon 48 or 
tool erase icon 47, the former allowing the user to 

so move the tool to another location on the display 
and the latter allowing the user to erase the tool 
from the display.) 

For example, if it is assumed that a purchaser 
wishes to purchase the CONVERTIBLE mode!, 

55 then the user points to that entry. As shown in FIG. 
4, the form entry system, responsive thereto (a) 
inserts the name CONVERTIBLE in field 41, (b) 
erases menu 40 from the display of panel 15. (c) 
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highlights the next field— the Year field-and (d) 
brings up the corresponding tool 50 to fill in that 
field. — 

It is assumed for the purpose of illustrating the 
invention that SMC has an inventory of automobiles 
that it manufactured during the years 1978 through 
.1986 and the entries tin tool 50 reflect that fact. To 
enter the appropriate information in field 51, then, 
all that the user needs to do is to point to one of 
the entries displayed in tool 50. Assuming that the 
user selects the entry 1986, the system (a) inserts 
1986 in field 51. (b) erases tool 50 from the dis- 
play, (c) highlights the next field to be filled in, i.e., 
the Qty field, and (d) displays the tool for filling in 
that field. 

Turning then to FIG. 5, there is shown form 30 
at the point where fields 41 and 51 have been filled 
in and field 61 is highlighted, indicating that field 61 
is the next field to be filled in by the user. The 
device for filling in field 61 -number entry tool 60-- 
has also been brought up on the display. The 
number entry tool 60 operates similar to a standard 
hand-held calculator in which the user composes a 
string of numbers by touching individual ones of 
the displayed buttons of tool 60, for example, the 
button labeled 0 (zero), as though the user were 
touching the number buttons on a hand-held cal- 
culator or the number buttons on a computer key- 
board. 

Number entry tool 60 also includes four func- 
tion keys 63 through 66. Briefly, the BS (back 
space) key 63 allows the user to backspace to 
overwrite a digit displayed in the display section 
62. The C (clear) key 64 clears the number dis- 
played in display section 62. The E (enter) key 65 
allows the user to transfer the number displayed in 
display section 62 to the highlighted field, i.e., field 
61, but the system does not automatically skip, or 
advance, to the next field to be filled in. To ad- 
vance to the next field, the user would have to 
point to it. When the user does so, the system 
highlights that field (i.e., the Bid Date field) and . 
brings up the tool for filling in the field. The E'S 
(enter/skip) key 66 causes the system to transfer 
the number displayed m display section 62 to field 
61 and advance to the next field to be filled in. 

In the illustrative example of the present inven- 
tion, it is assumed that the number of automobiles 
to be ordered is ten. Accordingly, the user touches 
the digits 1 and 0, respectively, to enter the num- 
ber 10. In turn, the system displays the digits in the 
display section 62 of tool 60, as shown in FIG. 6. 

FIG. 6 depicts the result of the user having 
pointed to the BS key 66 of tool 60. It is seen that 
the system has inserted the number 10 in field 61 
and has highlighted the Bid Date field 71 to in- 
dicate to the user that that field is the next field to 
be filled in. The system has also brought up the 


tool 70 for filling in field 71, which, in this case, is a 
date and time entry tool 70 that is updated periodi- 
cally. The current date 71 and time 73 displayed in 
tool 70 are derived from computer 20. 

5 Since the Bid Date field 71 calls for a date and 

not a time, the user points to the E'S key 74 of tool 
70. When the user does so, the system inserts the 
current date 72 in the associated field 71 and 
advances to the next field to be filled in. 

io As will be discussed below, the form entry 

system of the present invention may be pro- 
grammed, in accordance with a feature of the in- 
vention, to advance to any field in the form. Thus, 
the system may be programmed, for example, to 

75 pass over one or more*fields and to return to those 
fields after the other fields have been filled in. 

Turning . then to FIG. 7, there is shown an 
example in which the system has been pro- 
grammed to pass over field 85-1 and highlight field 

20 81. The system has also brought up keyboard tool 
80, since field 81 calls for the insertion of a name. 

Specifically, tool 80 is patterned after a con- 
ventional keyboard having a display section 82. 
The user may, for example, compose a name by 

25 pointing to respective ones of the displayed keys 
of tool 80. When the user touches a key, for 
example, the key labeled C, the system displays 
that letter in display section 82 of toot 80. Upon 
composing the customer's name and seeing it dis- 

30 played in display section 82, as shown in FIG. 7, 
the user then enters the name in the associated 
field 81 by pointing to the E'S key 83. 

At this point in the discussion, it is assumed 
that, upon filling in field 81, the system is pro- 

35 grammed to skip over fields 85-2 and 85-3 and 
advance to the Return Request To field 91. When 
the system advances to field 91, it highlights that 
field and brings up the corresponding tool for filling 
in the field, such as a menu of names (not shown). 

40 In the present illustrative example of the invention, 
when the user selects one of the names in the 
displayed menu of names, the system inserts the 
selected name in field 91 and advances to DLR 
INFO 90. 

45 In certain instances, it may be advantageous to 

allow a central location, such as a host computer, 
to determine the information that is to be inserted 
■ in a field of a form. For example, a unique number 
is typically printed on each copy of a printed form 

so to distinguish one copy of the form from another 
copy. The preprinted form number thus prevents 
the same number from being used on more than 
- one copy of the form, which may not be ensured if 
the person who is filling in the form also fills in the 

55 form number, since the person could mistakenly 
write the same number on more than one order 
form. 

Also, in certain instances, the same information 
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may be inserted in a particular field(s) of a form 
each time a copy of the form is filled in, such 
information being, for example, the phone number 
of the dealer inserted in field 85-3. 

In accordance with a feature of the invention, 
the form entry system may be programmed to 
communicate with other equipment, such as a host 
computer, via an application program to obtain 
information for filling in one or more fields of a 
form, such as fields 85-1 through 85-7. 

Turning then to FIG. 8, there is shown form 30 
with DLR INFO 90 highlighted. In this instance, 
DLR INFO 90 provides the function of a "button" 
rather than a field. When the user touches button 
90, computer 20 communicates with a host com- 
puter via an application program (discussed be- 
low) to obtain the information for filling in fields 85- 
1 through 85-7. Upon obtaining such information, 
the system automatically (a) inserts it in fields 85-1 
through 85-7, (b) removes the highlighting at button 
90 and (c) advances to the option section 31 of the 
form, as shown in FIG. 9. 

It is seen from FIG.9 that the system, in advan- 
cing to option section 31, has highlighted field 101 
and has brought up tool 100 comprising a menu of 
alternatives which the user operates to fill in that 
field in the manner as discussed above. The re- 
maining fields of section 31, ie., the fields labeled 
Engine through Ex Sys. are filled in by the user as 
each of those fields is highlighted and the respec- 
tive tool is displayed. 

It is assumed at this point in the discussion 
that page 1 of form 30 has been filled in the 
system has highlighted the SP EQUIP (special 
equipment) button 102. When the user points to 
button 102, the system erases page 1 of form 30 
and displays page 2 of form 30, as shown in FIG. 
10. 

It is seen from FIG. 10 that the fields in the top 
section of page 2 and the fields in the top section 
of page 1 of form 30 are identical. Accordingly, the 
system, upon bringing up page 2 of the form, 
automatically fills in those fields using the informa- 
tion inserted in the corresponding fields of page 1. 
In bringing up page 2, the system also highlights 
field 110 of form 30. 

Specifically, field 110 is, in accordance with a 
feature of the invention, a bit-mapped graphics field 
which permits the user to "write in" instructions in 
the field. These instructions may be, for example, 
special equipment items to be ordered from SMC. 
Other instructions, such as the method of delivering 
the automobiles to the purchaser, may also be 
written in field 110 as well as the signature of the 
person filling in form 30. In the present example of 
the invention, the special equipment item called 
"cruise control" is being ordered. Accordingly, the 
user writes in the name of that item in field 110 


using a hand-held stylus. In turn, the system tracks 
the points on touch screen 16 that is being touched 
by the stylus and illuminates the corresponding 
points on the ac plasma display of panel 15, there- 

5 by tracking the user's handwriting. Upon filling in 
field 110, the user touches the RTN (return) button 
111. When the user does so, the system erases 
page 2 and redisplays page 1 of form 30. 

Page 1 of form 30 includes a COMP 

10 (complete) button 103. as shown in FIG. 9. Upon 
filling in the form, the user touches button 103. In 
response thereto, the system illustratively (a) stores 
the various field entries in a so-called hand-off file, 
(b) erases form 30 from the display and brings up 

15 a fresh form 30, as shown in FIG. 3, and (c) passes 
the hand-off file to the host computer for process- 
ing. 

Other functions related to either filling in form 
30 or creating a customized form can be invoked. 

20 or selected, by pointing to. i.e., touching, individual 
ones of the function keys 32 through 37 displayed 
along the top of form 30, as shown in FIG. 9. 
Briefly, key 32 is blank and available for future use, 
such future use__ being, for example, an edit key 

25 which causes a menu of editing functions to be 
displayed when the user touches key 32. The SPE- 
CIALS key 33 provides two functions, the first 
function allowing the user to store a customized 
form in hard disk, and the second function allowing 

30 the user to calibrate a touch point on touch screen 
16 with eitheVthe ac plasma display of panel 15 or 
display 21 of computer 20 if the touch screen 
happens to be overlaying the latter display. The 
HIGHLIGHT key 34 allows the user to change the 

35 contrast of form 30 when it is being displayed from 
light to dark or vice-versa. The TOOLBOX key 35 
displays a menu of predfined "tools" as will be 
discussed below. The STYLUS key 36 changes the 
style of handwriting displayed in a bit-mapped 

40 graphics field of form 30 to either fine or bold point 
writing. The CLEAR key 37 allows the user to 
either clear one or all of the filled in fields of a 
displayed form. 

In certain instances the tool that the system 

45 brings up for filling in a corresponding field may be 
out of date. For example, assume that SMC adds a 
new tire to its product line and that the tool 100, 
shown in FIG. 9, has not been updated to include 
the new tire as an option. Thus, tool 100 could not 

so be used to fill in field 101 if the new tire is the 
selected option. This problem is dealt with, in ac- 
cordance with a feature of the invention,- by allow- 
ing the user to bring up another tool, such as the 
keyboard shown in FIG. 7, and use that tool to fill 

55 in field 101. The user brings up the keyboard by 
first touching the erase icon of the displayed tool, 
which erases the displayed tool, and then touching 
the toolbox function key 35, which displays a menu 
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of predefined tools. 

Turning then to FIG. 11, there is shown the 
menu 115 of predefined tools that is displayed as 
an overlay when the user touches function key 35. 
The user may redisplay the tool that was erased 
from the screen by touching the corresponding one 
of the tools 1 through 8. For example, tool 100 
(shown in FIG. 9) is redisplayed by touching menu 
item 1 and is redisplayed with an E/S button if 
menu item 2 is touched. In particular, the user may 
bring up either the keyboard tool 80 (shown in FIG. 
7), the number pad tool 60 (shown in FIG. 5) or the 
date and time tool 70 (shown in FIG. 6) by touching 
either menu item 4, 5 or 6. respectively. The user 
may bring up a date pad tool (not shown) by 
touching item 3. The date pad that is brought up 
on the display has a format that is similar to the 
format of number pad 60 and is used to insert a 
date in a field when the date to be inserted is not 
the current date. The user may bring up a calcula- 
tor tool (not shown) by touching item 7. The cal- 
culator tool is similar in appearance to a conven- 
tional hand-held calculator and includes four regis- 
ters. The user operates the displayed calculator as 
though the user was operating a hand-held calcula- 
tor. The user may also bring up the four calculator 
registers (not shown) without bringing up the cal- 
culator by touching menu item 8. 

The foregoing was discussed in terms of dis- 
playing a customized form and the tools that are 
■used to enter data in the fields of the form. Alter- 
natively, the present invention may be adapted to 
bring up a tool which is used to perform a specific 
function other than inserting data in a field. 

For examplle, FIG. 12 shows tool 120 which is 
patterned after a telephone station set and which 
may be brought up on panel 15 when the latter is 
connected to a computer having the capability to 
establish a telephone connection, such as the 
AT&T UNIX PC 7300. 

Specifically, the buttons bearing the labels 1 
through 0, * and # represent telephone buttons 
which the user touches as though he or she were 
touching the similarly labeled buttons on a conven- 
tional telephone station set to dial in a telephone 
number. Included in telephone tool 120 are buttons 
121 through 124 which are used to invoke well- 
known telephone features. For example, Confer- 
ence button 121 is used to establish a conference 
call. Drop button 122 is used to terminate a call, 
Transfer button 123 is used to transfer a call to 
another station or computer and Hold button 124 is 
used to place a call on hold. Telephone tool 120 
also includes fields 125-1 through 125-3 which 
display the status of respective telephone lines 
connected to the computer. FIG. 12 shows two 
such telephone lines— Line 1 and Line 2-in fields 
125-1 and 125-2, respectively. Field 125-3 is 


shown blank to indicate that it is reserved for a 
third telephone line not yet connected to the com- 
puter. Each of the fields 125-1 through 125-3 has 
associated therewith two other fields, such as fields 

5 126 and 127, to simulate the functions performed 
by the well-known in-use lamps that are found on 
conventional business telephone station sets. For 
example, field 126 represents the red in-use lamp 
and is highlighted to indicate to the user that line 1 

jo is the line that will be used (or is being used) when 
placing a telephone call. It is noted that the com- 
puter wilt typically select line 1 and will place that 
line in the off-hook state when tool 120 is brought 
up on the display. The user may select line 2 by 

75 touching field 125-2, in which case, the computer 
places line 1 in the on-hook state if a call has not 
been established over that line and places line 2 in 
the off-hook state. 

Field 127 represents the green in-use lamp and 

20 is highlighted to indicate to the user that the asso- 
ciated line is active. Field 127 may also be placed 
in a flashing mode by highlighting and removing 
the highlighting from field 127 to indicate, for ex- 
ample, that a call is being received over the asso- 

25 ciated line. 

Field 128 represents an intercom button which 
is highlighted when the user touches field 128. In 
that event, the computer connects the user to an 
intercom line. Fields 129-1 through 129-5 represent 

30 the well-known one-touch dialing buttons that are 
found on conventional station sets. For example, if 
the user wishes to place a telephone call to the 
person named in field 129-1, i.e., DAY, then all the 
user needs to do is to touch that field rather than 

35 dialing the person's telephone number using the 
displayed telephone keypad. 

In operation, when tool 120 is brought up, 
fields 126 and 127 are- highlighted indicating that 
line 1 is the active line. When the user touches one 

40 of the digits of the displayed keypad, for example, 
the digit labeled 2, the form entry system passes 
the coordinates of the touch point to an application 
program, as will be discussed below. The applica- 
tion program, in turn, causes the computer to out- 

45 pulse the digit over line 1. line 1 and line 2 being 
connected to, for example, a telephone company 
central office. The form entry system operating in 
conjunction with the application program handles 
the remaining digits touched by the user in the 

so same fashion to establish a telephone connection 
to the desired telephone number. 

According to a feature of the invention, the 
user may design his or her own customized form 
for a particular' application. In designing such a 

55 form the use specifies, using various commands, 
where on the screen the rectangles (fields), lines, 
text and graphic images should be placed, such 
commands being stored in a screen file as they are 
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being inputted by the user via keyboard 23 of 
computer 20 (FIG. 1). The user also specifies the 
attributes of each field, i.e., the highlighting of the 
field, the tool that is brought up when the field is 
highlighted, the next field that is highlighted when 
the current field is filled in, etc., as will be dis- 
cussed below. In discussing the design of a form, 
reference will be made to FIG. 2. 

Returning then to FIG. 2. it is noted that func- 
tion keys 32 through 37 are typically displayed 
regardless of which form or tool is brought up. 
function keys 32 through 37 being displayed over 
illustratively the first 30 rows of picture elements 
(pixels). Thus, the beginning (upper left-hand cor- 
ner) of form 30 starts at row 31 of the display. It is 
seen from FIG. 2, that a demarcation between form 
30 and keys 32 through 37 is established by the 
bold line 22. A line in a form, such as line 22. may 
be specified using illustratively a line command as 
follows: 

putline(x1 t y1 .x2,y2.linewidth) 
where xl and yl are the horizontal and vertical 
coordinates (row and column) of one endpoint of 
the line, x2 and y2 are the coordinates of the other 
endpoint of the line and linewidth is the thickness 
of the line, in pixels, and is restricted to 1, 2 or 3, 
such as the thickness of lines 20, 21 and 22. 
respectively. Accordingly, the command that is in- 
putted to display line 22 is as follows: 
putline (31,3.31.635.3) 

(It is noted that the putline command may also 
be used to bring up a diagonal line by specifying 
the coordinates of the endpoints of the line.) 

A horizontal line may be displayed using illus- 
tratively the command, 
puthline(x,y,iength,linewidth) 

where x and y are the coordinates of the upper-left- 
most pixel of the line and length is the length of the 
line in pixels. Thus, line 22 may also be inputted as 
follows: 

puthline(31 ,3,635,3) 

A vertical line may be displayed using illustra- 
tively the command, 
putvline(x,y .length, linewidth) 
where length in this case is the height (number of 
rows) of the vertical line. 

Text may be inserted in a form using illustra- 
tively a text command as follows: 
puttextl (x.yh.font, "text") 

where x is the horizontal coordinate of the location 
of where the text is to begin, .yh is the top pixel of 
the text string, font specifies the type of font to be 
used (for example, the type of font that is used to 
spell out "SATURN", "Model" or "Required Op- 
tions" shown in FIG.1), and text is the string of text 
to be displayed. Thus, the user inputs trie following 
commands to display the text that is shown across 
the the top of form 30: 


puttext1(28.37,9,"SATURN") 

puttextl (250.37, 1 "Special Equipment Worksheet 
Page 1 ") 

The following sequence of commands estab- 
5 lishes the first set of fields of form 30; namely, the 

Model Year, Qty, Bid Date and Saturn Ord. fields: 

puthline(3,60,537,2); (1) 

putvline(3,60.l05.2); (2) 

puttextl (15.65,1. "Model"): (3) 
io putvline(95.60.35,1); (4) 

puttextl (98.65,1 ."Year"); (5) 

putvline<1 35.60,35,1); (6) 

puttextl (138,65.1, "Qty"); (7) 

putvline<1 90,60,35,1); (8) 
is puttextl (193,65,1, "Bid date") (9) 

putvline(325,60,35,1); (10) 

puttextl (328,65,1 ."Saturn Ord. No.") (1 1 ) 

putvline(540.60.70,2); (12) 

puthline(3,95, 537,1); (13) 
20 Of the above commands the first command (1) 

displays horizontal line 11, commands 2, 4, 6, 8. 10 

and 12 display vertical lines 23 through 28. com- 
mands 3, 5, 7, 9 and 1 1 display the labels for those 

fields, respectively, and command 13 displays line 
25 20. 

A field may also be displayed on a display 
using a command which displays a rectangle. For 
example, either of the following commands may be 
used to draw any size rectangle, anywhere on the 

30 display: 

putrect! (x1 ,y1 . width, heightjinewidth) 
putrect2(xl.yl,x2.y2.linewidth) 

Where xl and y1 are the horizontal and vertical 
coordinates of the upper left corner of the rectan- 

35 gle, respectively, x2 and y2 are the horizontal and 
vertical coordinates of the lower right corner of the 
rectangle, respectively, width and height are the 
width and height (including the border lines) of the 
rectangle, respectively, and linewidth is the width in 

40 pixels of the border around the rectangle. Thus, a 
rectangular field and the text identifying the field, 
such as button 90, may be drawn on the display as 
follows: 

putrectl (565,75.55.50,2) 
45 puttextl (576.85,2,"DLR") 

puttextl (574,103,2."INFO") 

Once the form designer has completed the 

layout of the fields of the desired form using the 

above mentioned commands, he or she then sped- 
so fies the attributes of the fields, i.e., the highlighting 

of the respective field, which tool is brought up 

when the field is highlighted, which field is next 

highlighted after the field is "filled in", etc. 

In particular, either of the following commands 
55 specify the highlighting of a field: 

deflitel (litenum.xl ,yl .width.height) 

deflite2(litenum.x1 ,y1 ,x2.y2) 

where litenum is an integer which uniquely iden- 
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tifies the area to be highlighted, xl and y1 are the 
horizontal and vertical coordinates of the upper left 
corner of the highlighted area, respectively, width 
and height are the width and height of the highligh- 
ted area, respectively and x2 and y2 are the hori- 
zontal and vertical coordinates of the lower right 
corner of the highlight area, respectively. For ex- 
ample, fields 41, 51, 61, 71 and 75 are highlighted 
by inputting the following commands: 
deflitel (1.3.60.92,35); 
deflitel (2.95,60,39,35); 
deflitel (3,1 35,60,54,35); 
deflite1(5, 190.60.135.35); 
deflitel (10,325,60,21 4,35); 

The other attributes of a field may be specified 
using, for example, the following command: 
deffldi (fldnum, "fIdname M .xi ,yi .width.height.type, 
litenum.autotool.xtool.ytool.autoskip.enable, 
keygroup.font.valid.vmin.vmax); 

Where fldnum is an integer uniquely identifying 
the respective field: fldname is the name (label) 
displayed on the corresponding tool that is speci- 
fied in the "autotool" field of the command and is 
the name that is used when the system displays 
validation errors; x1 and yl are the horizontal and 
vertical coordinates of the upper left corner of the 
field; respectively; width and height are the width 
and height of the respective field; type is the field 
type, such as a bit-mapped-graphics field or an 
ASCII text area: litenum is the number of the asso- 
ciated .highlighted area, mentioned above, autotool 
identifies the particular tool that is displayed when 
the field is highlighted, for example, the values 1 
through 8 are used to specify the predefined tools 
shown in FIG. 11, respectively, the value 0 is used 
to signify a null state, i.e., no tool: xtool and ytool 
are the horizontal and vertical coordinates of the 
upper left corner of the tool to be displayed; auto- 
skip is the number of the next field to be highligh- 
ted; enable is the field number (if any) of another 
key field which must be activated before current 
field can be activated; font is the type of font to be 
used when inserting the entry in the respective 
field; valid is an indication of whether a validation is 
to be done on the selected entry before it is 
entered in the field, for example, validating a date 
that is to be entered in the field, vmin and vmax 
specify the range of the validation, such as whether 
a number falls within the range of vmin and vmax. 

The attributes of, for example, fields 41 and 51 
of form 30. may be specified (inputted) as follows: 
defftd1(1, w MODEL\l5,82,79.12.4,1. 2,175,100,2, 
0,0.0.0.0.0); 

deffldi (2. "YEAR", 101. 82,33.12.4.2.2.175.100.3, 
0,0.0.0.0,0); 

(It is noted that the attributes of a field may be 
specified using, alternatively, a deffld2 command, 
the format of the defftd2 being similar to the format 


of the deffldi command.) 

The following command may be used to speci- 
fy which field is to be highlighted when illustratively 
a form is first displayed: 

5 defstart (fldnum); 

where fldnum is defined above in connection with 
defining the deffldi command. 

We turn now to the hardware and software 
which implement the present illustrative embodi- 

iq ment of the invention. 

FIG. 13 is a simplified block diagram of com- 
puter 20. At the heart of the computer is a micro- 
processor 21 1 which communicates with its periph- 
erals via a bus 210. These peripherals include 

J5 ROM 213, RAM 215,- memory management cir- 
cuitry 212, hard and floppy disk units 214 and 217. 
respectively, interrupt controller 218. video control- 
ler 220 and various other peripherals denoted col- 
lectively at 216. As mentioned above, touch screen 

20 controller 219 is used to determine the x and y 
coordinates of a location on touch screen 16 that is 
being touched by the user. 

Specifically, touch screen 16 of panel 15 com- 
prises a glass plate with a transparent resistive 

25 coating that is fired onto the active side of the 
glass plate at a high temperature to provide a 
voltage divider. A mylar contact sheet is stretched 
over the glass substrate and is held above the 
resistive coating by separator points. Finger or 

30 stylus pressure causes' the mylar cover sheet to 
deform and make electrical contact with the resis-. 
tive coating at the point of touch. Controller 219. 
which can be, for example, the Eiographics E271- 
101 controller, periodically impresses a voltage 

35 gradient across the resistive coating on the glass 
plate via a pair of leads of cable 17. The voltage 
graident is alternately applied between the x and y 
directions to obtain voltages which are analog re- 
presentations of the coordinates of the location on 

40 touch screen 16 that is being touched by the user. 
These analog voltages are digitized by controller 
219 and transmitted to microcomputer 211 for pro- 
cessing. 

Ac plasma display 18 of panel 15 is composed 
45 of multiple rows and columns (400 x 640) of in- 
dividual gas cells (pixels), formed at the intersec- 
tion of a cover glass and two (addressing and 
common sustain) parallel substrate electrodes. The 
control circuitry (not shown) upon receiving digital 
so video signals from controller 220 ignites individual 
gas pixels to form a pattern on display 18, such as 
the screens depicted in FIGS. 2 through 12, To 
illuminate a pixel on display 18, a neon-argon gas 
mixture within the corresponding cell is excited by 
55 applying a high voltage potential across the the 
cover glass electrode and addressing substrate 
electrode, thereby causing the gas mixture to be- 
come ionized and emit light. Ionization is sustained 
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by transferring the electrical charge from the cover 
glass electrode to the common sustain substrate 
electrode. The pattern brought up on display 18 is 
erased by removing the sustaining voltage from the 
common sustain substrate electrode. 

FIG. 14 is a simplified block diagram of central 
(host) computer 140 and a plurality of computers 
20-1 through 20-N. Computer 140 is a multiserver 
computer, such as Digital Equipment Corporation's 
VAX-1 1/780 operating under, for example, the 
UNIX operating system, and having stored therein, 
such as in memory 141, the earlier mentioned 
handoff files that it receives from respective ones 
of computers 20-1 through 20-N. Also stored in 
memory 141 are the entries that are inserted in 
illustratively fields 85-1 through 85-7 of form 30, as 
discussed above. 

Each of the computers 20-1 through 20-N can 
be either a personal computer, such as computer 
20, workstation, or another VAX-1 1/780. Computers 
20-1 through 20-N communicate with computer 140 
over respective bidirectional communication paths 
14-1 through 14-N. Such communication .paths can 
be either a hard-wired connection, a telephone line, 
or a local area network, the latter being repre- 
sented by dashed line 14-N. It is seen that com- 
puter 20-3 also has two telephone lines L1 and 12 
connected to it. Lines L1 and L2. in turn, connect to 
a telephone company centra! office (CO) so that 
computer 20-3 can establish a telephone connec- 
tion between telephone station set S1 and the 
central office when it is directed to do so by a user 
using station set tool 120 shown in FIG. 12. 

Each of the computers 20-1 through 20-N is 
arranged to implement the invention and each is 
connected to a respective touch screen and display 
panel 15-1 through 15-N via respective cables 17-1 
through 17-N. In the practice of the invention, each 
of the computers 20-1 through 20-N may be ar- 
ranged to bring up the same form, such as form 30 
discussed above, different pages of a form, dif- 
ferent customized forms, or a different customized 
toots, in which a customized tool performs a spe- 
cific function, as discussed above. 

As mentioned above, a form may be displayed 
via an application program designed by the user. 
The application program may be, for example, a 
program which firsts displays, for example, instruc- 
tions to the user, erases the instructions and then 
directs the form entry system to bring up a particu- 
lar form. It could also be a program which controls 
the display of a series of forms or pages of a form, 
such as page 1 and page 2 of form 30, discussed 
above. The application program could also be a 
program which responds to user inputs when, for 
example, the station set tool of FIG. 12 is displayed 
on either panel 15 or display 21, 

Turning then to FIGS. 15 and 16, there is 


shown a flowchart of an application program, as 
represented by block 1501, and the form entry 
system program, as represented by blocks 1502 
through 1533. FIGS. 15 and 16 should be arranged 

5 as shown in FIG. 17. Hereinafter the form entry 
system program will be referred to as the program. 
It is assumed that the application program at block 
1501 is arranged to pass the name of a file con- 
taining the commands for displaying a customized 

;o form to block 1502. Upon receiving the name of the 
file, the program at block 1502 executes the com- 
mands contained in the file, the commands being, 
for example, the above mentioned puthline, putv- 
line and puttext commands. The program then pro- 

T5 ceeds to block 1503 where it scans the file for a 
defstart command. If the file contains a defstart 
command, the program executes the command 
and then proceeds to block 1504. If the file does 
not contain a defstart command, then the program 

20 executes the deffldi command associated with the 
first field of the displayed form and then proceeds 
to block 1504. 

At block 1504, the program determines if it 
should return to the application program, i.e., the 

25 value in the autoskip field of the deffldi command 
being executed equals illustratively 126 or 127. If 
the autoskip field contains a number other than 1 26 
or 127, then the program proceeds to block 1505. 
Otherwise, it returns to. the application program. 

30. At block 1505. the program test? the value 

contained in the autotool field of the deffldi com- 
mand being executed. If the value is zero, then the 
program proceeds to block 1506 where it waits for 
a response from the user. Otherwise, the program 

35 proceeds to block 1515 to bring up the tool iden- 
tified in the autotool field. 

The program at block 1506, waits for the user 
to touch the touch screen. When the user touches 
the touch screen of panel 15. the program pro- 

40 ceeds to block 1507 to determine if the user has 
touched a point within the boundary of a displayed 
field. If not, the program proceeds to block 1508 to 
check if the user has touched of one the function 
keys 32 through 37. If the program finds that the 

45 user has not touched one of those keys, it then 
proceeds to block 1509 to output an audible tone 
as an indication that the user has touched an 
invalid point. The program returns to block 1506 
upon outputting the tone to wait for the next input 

so from the user. 

If the program at block 1508 finds that the user 
has indeed touched one of the function keys 32 
through 37 it proceeds to block 1511 where it 
displays a menu of functions asociated with the 

55 touched key, as discussed above. The program 
then proceeds to block 1512 upon completing that 
task. Block 1512 is representative of a software 
program which (a) waits for the user to select one 
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of the items from the displayed menu and (b) 
processes the item selected by the user. After 
processing the user's selection, the program re- 
turns to block 1506 to wait for the next input from 
the user. 

If, on the other hand, the determination made 
at block 1507 turns out to be positive, i.e., the 
program finds that the user has touched a valid 
field, then it proceeds to block 1510. At block 1510, 
the program tests the type field of the deffldl 
command associated with the field touched by the 
user. If the type field indicates that the displayed 
field is a bit-mapped-graphics (BMG) field, then the 
program proceeds to block 1513. Otherwise, it pro- 
ceeds to block 1514 where it erases the highlight- 
ing from the currently active field (if any) and 
highlights the field touched by the user. The pro- 
gram then proceeds to block 1504 to execute the 
deffldl command associated with the newly high- 
lighted field. 

At block 1513, the program highlights the point 
on the display having the same coordinates as the 
touch point, as discussed above. The program then 
proceeds to block 1506. 

As mentioned above, the program at block 
1515 displays the tool identified in the autotool field 
of the deffldl command being executed. It then 
proceeds to block 1516 to wait for the user to 
touch the tool. 

When the user touches the tQuch screen the 
program proceeds to block 1517 to determine if the 
touch point is within the boundary of the displayed 
tool and transfers to block 1519 if it finds that to be 
the case. Otherwise, it proceeds to block *1518 
where it outputs an error and returns to block 1516 
to await receipt of the coordinates of the next touch 
point. 

At block 1519, the program tests to see if the 
user has touched the exit icon of the displayed tool 
and proceeds to block 1 520 if the result of the test 
turns out to be affirmative. At block 1520, the 
program erases the displayed tool and then pro- 
ceeds to block 1506. Otherwise, the programs pro- 
ceeds to block 1521 if the results of the test made 
at block 1520 turns out to be negative. At block 
1521 the program determines if the user has 
touched the move icon of the displayed tool and 
proceeds to block 1522 if it finds that to be the 
case. At block 1522, the program "moves" the 
displayed tool in the direction of the point touched 
by the user. The program upon "moving" the tool 
returns to block 1516. 

The program, on the other hand, proceeds to 
block 1523 if it finds that the user has not touched 
the move icon. At block 1523, the . program deter- 
mines if the tool that is being touched is one of the 
predefined tools, discussed above, if it finds that to 
be the case, then the program proceeds to block 


1524. Otherwise, the program considers the dis- 
played tool to be a tool that is defined by the user, 
for example, station set tool 120 shown in FIG. 12, 
and proceeds to block- 1525 where it passes the 

5 input (coordinates of the touched point) to the 
application program. The program then proceeds to 
block 1516 upon completing that task. 

At block 1524, the program determines if the 
tool that is being displayed is a menu without an E 

to or E'S key, such as menu 40 depicted in FIG. 3. If 
this determination is affirmative .then the program 
transfers to block 1 526 where it (a) loads the menu 
item touched by the user in the corresponding 
field, (b) removes the highlighting from the field, 

75 and (c) proceeds to block 1527 to erase the dis- 
played tool. The program proceeds to block 1528 
upon completing the above task. 

Block 1528 is representative of a software rou- 
tine which (a) transfers to block 1506 if the user 

20 has touched the E key of the previously displayed 
tool or the autoskip field of the command being 
executed contains a zero, or (b) transfers to block 
1529 to highlight the next field if the user has 
touched the E'S key of the previously displayed 

25 tool. At block 1529, the program highlights the field 
identified by the value contained in the autoskip 
field of the command being executed and then 
transfers to block 1504 to execute the deffldl com- 
mand associated with the newly highlighted field. 

30 If the determination made at block 1524 is 

negative, then the program proceeds to block 1530 
where it tests the coordinates of the touch point to 
see if they match the coordinates of either the E or 
E'S key of the displayed tool and transfers to block 

35 1526 if it finds that to be the case. Otherwise, it 
proceeds to block 1531. 

At block 1531, the program determines if the 
displayed tool is the calculator tool and passes the 
coordinates of the touch point to block 1532 if it 

40 finds that to be the case. Block 1532 is representa- 
tive of a calculator program which processes user's 
inputs when the calculator tool is displayed. The 
calculator program processes inputs similar to the 
way that a hand-held calculator processes inputs. 

45 The calculator program also displays the result 
brought about by the user's input (i.e., the result of 
a multiplication, division, addition, etc.) in the dis- 
play section of the tool, as represented by block 
1533. 

so If the result of the determination made at block 

1531 is negative, then the program proceeds to 
block 1533 where it displays the designation 
(label) of the tool button that is displayed at the 
coordinates of the point touched by the user, the 

55 label being displayed in the display section of the 
tool. Block 1533 then transfers to block 1516 upon 
completing its task. 

FIG. 18 illustrates a layout of the (a) application 
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program and form entry system program of FIGS. 
15 and 16, (b) customized forms, such as form 30, 
(c) tools, such as tools 40, 50, 60. 70. 80, 100, and 
120, discussed above, and (d) hand-off file, dis- 
cussed above, in the hard disk 214 of computer 20. 

The foregoing is merely illustrative of the prin- 
ciples of our invention. Those skilled in the art will 
be able to devise numerous arrangements which, 
although not explicitly shown or described herein, 
embody those principles that are within its spirit 
and scope. 


Claims 

1. An arrangement for use in a computer hav- 
ing a display associated therewith comprising 
means for displaying on said display a pattern 
including a plurality of information fields and for 
identifying for each field a kind of information to be 
inserted therein, 
CHARACTERIZED IN THAT 
means for indicating a particular one of said in- 
formation fields into which information is to be 
inserted and for concurrently displaying a predefin- 
ed tool associated with said one of said fields, said 
predefined tool being operable to supply informa- 
tion of the kind identified for said one field, said 
tool being selected from a group of predefined 
tools including at feast a tool adapted to supply an 
individual entry from a menu of alternatives and at 
least a tool adapted to allow said user to compose 
said information, and 

means for inserting in said one field information 
that is derived as a result of said user operating 
said displayed tool. 

2. The arrangement set forth in claim 1 
FURTHER CHARACTERIZED IN THAT 

said group of predefined tools further includes a 
tool which displays transitory information, said tran- 
sitory information being changed periodically. 

3. The arrangement set forth in claim 2 . 
FURTHER CHARACTERIZED IN THAT 

said tool which displays transitory information in- 
cludes at least a date and time tool. 

4. The arrangement set forth in claim 1 
FURTHER CHARACTERIZED IN THAT 

said tool adapted to allow said user to compose 
said information includes at least a number pad, a 
keyboard, and a calculator. 

5. The arrangement set forth in claim 1 
FURTHER CHARACTERIZED IN THAT 

means for obtaining from a host computer the 
information that is to be inserted in one or more of 
said fields. 


6. The arrangement set forth in claim 1 
FURTHER CHARACTERIZED IN THAT 
said display includes a touch-sensitive screen over- 
laying said display. 

5 7. The arrangement set forth in claim 1 

FURTHER CHARACTERIZED IN THAT 
at least one of said fields is a bit-mapped-graphics 
field adapted to allow said user to compose said 
information by writing on said bit-mapped-graphics 

io field. 

8. The arrangement set forth in claim 1 
FURTHER CHARACTERIZED IN THAT 

means for displaying a menu of labels identifying 
respective ones of said group of predefined tools 
75 and for displaying one of said predefined tools 
when said user points to its label. 

9. The arrangement set forth in claim 1 
FURTHER CHARACTERIZED IN THAT 

said computer includes at least one telephone line 
20 connected to a telephone system and wherein on 
of said predefined tools is arranged to operate as a 
telephone station set when it is displayed on said 
display to allow said user to establish a telephone 
call over said at least one telephone line by touch- 
25 ing respective buttons displayed in said telephone 
station set tool. 
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© Touch screen form entry system. 

© A personal computer (20) connected to a display 
and touch screen panel (15) is prov'ded with a form 
entry system integrated therewith. The form entry 
system is adapated to display a predefined form 
(e.g. 30). and to automatically display a predefined 
tool, such as a keyboard, menu, calculator, etc., 
£2(40.50.60,70,80,100,1 10) to facilitate inputting infor- 
^mation in a respective field of the form or chart. 
O Specifically, the user is prompted as to which field is 
JO to be filled in by highlighting the field (e.g. 41), and 
^concurrently displaying as an overlay (window) the 
^tool (e.g. 40) that the user will use to input the 
^information identified in the highlighted field. In the 
case where a field calls for, for example, the inser- 
©tion of a name, the system may be adapted to 
display a menu of names as the tool for filling in that 
UJ field. The user selects the name that he or she 
desires to be inserted in the field by touching that 
name. The system responsive thereto inserts the 


name in that field, highlights the next field to be 
filled in and displays the tool for filling in that field. 
They system may also be adapted to communicate 
with a host computer (140) to obtain the information 
that is to be inserted in one or more fields. Also, the 
user may erase the tool that is displayed by the 
system an direct the system to display another tool, 
such as the aforementioned keyboard. 
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